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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re PATENT APPLICATION OF 
Inventor(s): PETTERSEN 
Filed: Herewith 

Title: SYSTEM FOR SCANNING OF THE GEOMETRY OF LARGE OBJECTS 

January 14, 2002 

PRELIMINARY AMENDMENT 

Hon. Commissioner of Patents 
Washington, D.C. 20231 

Sir: 

Please amend this application as follows: 

IN THE SPECIFICATION : 

At the top of the first page, just under the title, insert 

[X] -This application is the National Phase of International Application 
PCT /NO00/00235 filed July 10. 2000 which designated the U.S. 
and that International Application 

[X] was □ was not published under PCT Article 21(2) in English.— 

IN THE CLAIMS : 

Please amend claims 1-12, as follows: 

1 . (Amended) System for detection of the surface geometry of an object, comprising 
a sensor unit with apparatus for local, point by point detection of surface geometry, and a 
robot unit for moving the sensor unit, wherein the sensor unit includes an optical scanner unit 
for non-touch probing and detection of the surface geometry of the object, and a position 
measuring unit including a camera-based sensor designed for registering an image of a 
network including reference points in known positions and for determining the position of the 
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sensor unit in a global coordinate system defined by said network of reference points, and 
wherein a computing unit is provided and designed for collection of data from the scanner 
unit and the position measuring unit and for transformation of the data from the scanner unit 
to relate them to the global coordinate system. 

2. (Amended) System as defined in claim 1, wherein the robot unit is designed for 
stepwise movement of the sensor unit 

3. (Amended) System as defined in claim 1, wherein the network of reference points 
is on the object, and the position for each reference point in the network is known relative to 
a coordinate system related to the object. 

4. (Amended) System as defined in claim 1, wherein the robot unit is designed to 
move the sensor unit step-wise over the object. 

5. (Amended) System as defined in claim 1 , wherein the scanner unit is chosen from 
the following group: laser scanner, single-point distance meter, laser-based triangulation 
sensor combined with camera, triangulation sensor with two-axis scanning laser, triangulation 
sensor with laser raster projection in combination with camera, sensor based on pattern 
projection combined with at least one camera. 

6. (Amended) System as defined in claim 1, wherein the robot unit is chosen from 
the following group: arm-based robot, Cartesian robot, robot with one, two or more degrees 
of freedom, program controlled robot, real-time position-controlled robot based on registered 
position of the sensor unit in relation to the object and instruction for movement relative to 
current position. 
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7. (Twice Amended) System as described in claim 1, wherein said camera in the unit 
for measuring position is a CCD camera. 

8. (Twice Amended) System as described in claim 3, wherein the reference points 
are holes or depressions in the surface of the object. 

9. (Twice Amended) System as described in claim 3, wherein the reference points 
include targets placed on the object or in the mentioned holes or depressions in the surface of 
the object. 

10. (Amended) Method for detection of the surface geometry of an object, including 
use of a sensor unit comprising apparatus for local, point by point detection of the surface 
geometry, a position measuring unit to determine the position of the sensor unit in relation to 
a network of reference points in known positions relative to a global coordinate system, and a 
robot unit for moving the sensor unit, the method comprising: 

positioning the sensor unit such that a region of the surface of the object is inside a 
measurement volume of the apparatus, 

optically scanning said region by means of said apparatus; 

determining by means of said position measuring unit simultaneously the position of 
the optical scanning apparatus relative to the coordinate system of the network, and 

transferring data from the scanning apparatus to a computing unit where said data are 
transformed to the coordinate system of the network and stored. 

1 1 . (Amended) Method as specified in claim 10, wherein the robot unit moves the 
sensor unit in stepwise fashion. 
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12. (Amended) Method for calibration of a sensor unit which comprises apparatus 
for local detection of a surface geometry, and a position measuring unit to determine the 
position of the sensor unit in a global coordinate system relative to a network of reference 
points in known positions, and where the sensor unit is mounted on a robot unit for 
movement relative to an object, the method comprising: 

a) positioning the sensor unit such that at least one of the reference points is 
inside a measurement volume of the apparatus, said apparatus capable of optical scanning, 

b) determining the position of the reference point relative to the optical scanning 
apparatus, 

c) determining by means of the position measuring unit simultaneously the 
position of the sensor unit relative to the coordinate system of the network, 

d) repeating steps a-c or b, c until the positions of at least three reference points 
have been determined relative to the coordinate system of the optical scanning apparatus, and 

e) calculating a transformation matrix based on data registered by the scanning 
apparatus and the position measuring unit to describe the mutual relationship. 

See attached Appendix for the changes made to effect the above claims. 
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REMARKS 



Claims 1-12, as amended, are pending herein. Claims 1-12 have been amended to 
eliminate multiple dependency and to place the claims in better conformance with U.S. 



Attached hereto is a marked-up version of the changes made to the specification and 
claims by the current amendment. The attached Appendix is captioned "Version with 
markings to show changes made" . 

Prompt and favorable consideration is respectfully requested. 



PTB/jck 
Attachment: 
Appendix 
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McLean, VA 22102 
(703) 905-2000 
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Respectfully submitted, 

PILLSBURY WINTHROP LLP 
Intellectual Property Group 




Attorney: Paul T. Bowen 
Reg. No: 38,009 



Tel. No.: 703.905.2020 
Fax No.: 703.905.2500 



30253411J.DOC 



10/030913 

^Rec^PCT/PTG 14 JAN 2002 



APPENDIX 

VERSION WITH MARKINGS TO SHOW CHANGES MADE 

IN THE SPECIFICATION : 

At the top of the first page, just under the title, insert 

CK] — This application is the National Phase of International Application 
PCT/NOOQ/00235 filed July 10, 2000 which designated the U.S. 
and that International Application 

| ~1 was [Xl was not published under PCT Article 21(2) in English . — 



IN THE CLAIMS : 



Please amend claims 1-12, as follows: 

1 . (Amended) System for detection of the surface geometry of an object [(6)], 
comprising a sensor unit [(1)] with apparatus [(2)] for local, point by point detection of 
surface geometry, and a robot unit [(4)] for moving the sensor unit [(1)], [characterized in 
that] wherein the sensor unit [(1)] includes an optical scanner unit [(2)] for non-touch probing 
and detection of the surface geometry of the object, and a position measuring unit [(3) 
consisting of] including a camera-based sensor [(7)] designed for registering an image of a 
network [(8) consisting of] including reference points [(9)] in known positions and for 
determining the position of the sensor unit [(1)] in a global coordinate system defined by said 
network [(8)] of reference points [(9)], and [that] wherein a computing unit [(5)] is provided 
and designed for collection of data from the scanner unit [(2)] and the position measuring unit 
[(3)] and for transformation of the data from the scanner unit [(2)] to relate them to the global 
coordinate system. 



2. (Amended) System as defined in claim 1, [characterized in that] wherein the robot 
unit [(4)] is designed for stepwise movement of the sensor unit [(1)]. 
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3. (Amended) System as defined in claim 1, [characterized in that] wherein the 
network [(8)] of reference points [(9)] is on the object, and [that] the position for each 
reference point in the network is known relative to a coordinate system related to the object. 

4. (Amended) System as defined in claim 1, [characterized in that] wherein the robot 
unit [(4)] is designed to move the sensor unit [(1)] step-wise over the object [(6)]. 

5. (Amended) System as defined in [one or more of the preceding claims] claim L 
[characterized in that] wherein the scanner unit [(2)] is chosen from the following group: 
laser scanner, single-point distance meter, laser-based triangulation sensor combined with 
camera, triangulation sensor with two-axis scanning laser, triangulation sensor with laser 
raster projection in combination with camera, sensor based on pattern projection combined 
with at least one camera. 

6. (Amended) System as defined in [one or more of the preceding claims] claim 1 , 
[characterized in that] wherein the robot unit [(4)] is chosen from the following group: arm- 
based robot, Cartesian robot, robot with one, two or more degrees of freedom, program 
controlled robot, real-time position-controlled robot based on registered position of the sensor 
unit [(1)] in relation to the object and instruction for movement relative to current position. 

7. (Amended) System as described in [one or more of the preceding claims] claim L 
[characterized in that] wherein said camera in the unit [(3)] for measuring position is a CCD 
camera. 

8. (Amended) System as described in claim 3, [characterized in that] wherein the 
reference points [(9)] are holes or depressions in the surface of the object [(6)]. 
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9. (Amended) System as described in claim 3 [or 8], [characterized in that] wherein 
the reference points [(9) consist of so-called "targets"] include targets placed on the object 
[(6)] or in the mentioned holes or depressions in the surface of the object [(6)]. 

10. (Amended) Method for detection of the surface geometry of an object [(6)], 
including use of a sensor unit [(1)] comprising apparatus [(2)] for local, point by point 
detection of the surface geometry, a position measuring unit [(3)] to determine the position of 
the sensor unit in relation to a network [(8)] of reference points [(9)] in known positions 
relative to a global coordinate system, and a robot unit for moving the sensor unit, 
[characterized in the steps of] the method comprising : 

positioning the sensor unit [(1)] such that a region of the surface of the object [(6)] is 
inside a measurement volume of the apparatus [(2)], 

optically scanning said region by means of said apparatus [(2)]; 

determining by means of said position measuring unit [(3)] simultaneously the 
position of the optical scanning apparatus [(2)] relative to the coordinate system of the 
network [(8)], and 

transferring data from the scanning apparatus [(2)] to a computing unit [(5)] where 
said data are transformed to the coordinate system of the network [(8)] and stored. 

11. (Amended) Method as specified in claim 10, [characterized in stepwise moving 
of] wherein the robot unit moves the sensor unit [(1) by means of the robot unit (4)] in 
stepwise fashion . 

12. (Amended) Method for calibration of a sensor unit [(1)] which comprises 
apparatus [(2)] for local detection of a surface geometry, and a position measuring unit [(3)] 
to determine the position of the sensor unit in a global coordinate system relative to a network 
[(8)] of reference points [(9)] in known positions, and where the sensor unit [(1)] is mounted 
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on a robot unit [(4)] for movement relative to an object [(6)], [characterized in the steps of] 
the method comprising : 

a) positioning the sensor unit [(1)] such that at least one of the reference points 
[(9)] is inside a measurement volume of the apparatus [(2)] ? said apparatus capable of optical 
scanning, 

b) determining the position of the reference point [(9)] relative to the optical 
scanning apparatus [(2)], 

c) determining by means of the position measuring unit [(3)] simultaneously the 
position of the sensor unit [(1)] relative to the coordinate system of the network [(8)], 

d) repeating steps a-c or b, c until the [position] positions of at least three 
reference points [(9)] have been determined relative to the coordinate system of the optical 
scanning apparatus, and 

e) calculating a transformation matrix based on data registered by the scanning 
apparatus [(2)] and the position measuring unit [(3)] to describe the mutual relationship. 
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1 

SYSTEM FOR SCANNING OF THE GEOMETRY OF LARGE OBJECTS 

The present invention relates to a system as well as a method to scan the geometry of 
objects as described in the introduction to claims 1 and 1 1 . 

5 

A number of laser based scanners for measurement of surfaces exist. These are 
characterized by having a limited working volume, or limited measurement volume, 
requiring a specific offset from the surface, and requiring a specific orientation 
relative to the surface. Scanners are therefore often mounted on accurate coordinate 
10 measurement machines, such that the scanner can be moved step-wise across the 
surface to scan region after region. A coordinate measurement machine is complex, 
inflexible and costly. 

There is a need for more flexible, portable solutions. An alternative is attaching a 
15 scanner to a robot, in such a way that the robot moves the scanner across the object. 
For each position, a part of the surface is scanned. This measurement is registered 
relative to the position of the scanner, and is transformed to a global coordinate 
system provided by the robot. 

20 Most robots have low accuracy. Transformation of the data based on the robot's 

coordinate system will therefore not produce a sufficiently accurate description of the 
object's total geometry. Calibration of the robot to better describe its movements will 
help, but due to effects like wear and temperature variations, this is still not good 
enough. 

25 

The present invention combines a solution comprising a robot and scanner with use of 
a position measuring device as described in Norwegian Patent No. 303.595. The 
scanner and the position measuring device are integrated into one sensor unit. In this 
solution, the position measuring device provides information on the exact position of 
30 the scanner. The robot is only used to move the sensor unit. 

The characteristic features of the system and method are set forth in claims 1 and 1 1, 
respectively further embodiments are set forth in the dependent claims. 

35 Figure 1 shows the system solution. 



Figure 2 shows an alternative configuration. 
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Figure 3 shows as an example a scanner unit, a triangulation sensor. 

Figure 4 shows an example of a position measuring device as described in 
Norwegian patent No. 303.595. 

5 

Figure 5 shows a method for determining the internal geometry of the sensor unit. 

Figure 1 shows an example of a configuration of the system. It consists of principally 
two units, a sensor 1 and a robot 4. The robot is used to position the sensor in relation 
10 to the current area 12 on the object 6. The sensor 1 registers the local geometry of the 
object, and measures its own position relative to a global coordinate system 13. 

The sensor unit 1 consists of a scanner unit 2 for local scanning of geometry plus 
position measuring unit 3 to determine the sensor unit's own position relative to the 
is global coordinate system 13. The scanner unit 2, e.g. a laser scanner, emits a laser 
beam 1 1 which scans a limited region 12. The position measuring unit 3 registers its 
own position, and thereby the position of the sensor unit 1, relative to a network 8 of 
reference points 9. The positions of the reference points are known relative to the 
global coordinate system 13. 

20 

The system also includes a computing unit 5 which collects the data from scanner unit 
2 and position measuring unit 3 and transforms all information from the scanner unit 
to the same global coordinate system 13. The computing unit 5 also sends data to the 
robot 4 to control the robot's movement relative to the object. 

25 

Figure 2 shows an alternative configuration. The reference points 9 are attached to the 
object 6. The position measuring unit 3 is placed to view these reference points. 

The scanner unit 2 can e.g. be one of the following types, but is not limited to this: 

30 

• Laser distance meter which measures the distance between the scanner unit and the 
object in a single point, 

• Triangulation sensor based on single-axis scanning laser or laser line projection 
combined with camera (e.g. CCD sensor). Such a sensor scans one line from each 

35 sensor position. 

• Triangulation sensor based on dual-axis scanning laser or laser raster projection 
combined with camera (e.g. CCD sensor). 
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• Sensor based on projection of pattern combined with one or more cameras (e.g. 
CCD sensor). 

Figure 3 shows the principle for a triangulation sensor. It contains a laser 14 which 
5 emits a laser beam 1 1 or a laser plane (line projection). The laser projects a point 15 
or a line on the object 6. The point 15 is imaged through a lens 16 onto a sensor 17, 
e.g. a CCD array. The scanner unit 2 is calibrated in such a way that it measures the 
position of the point 15 relative to an internal coordinate system 18. In an alternative 
implementation, the laser beam can be aimed at the surface through a two-axis, 
10 movable mirror. In this way, a region of the surface can be scanned from each 
position of the triangulating sensor. 

The significant characteristic of the scanner is that it registers the local geometry of an 
object relative to the internal coordinate system of the scanner. For each scanner 
is position, a registration can be made of a point, points along a line, or points in a two- 
dimensional pattern. 

In a preferred embodiment the position measuring device 3 is of a type described in 
Norwegian patent No. 303.595, as shown in figure 4. Essentially, this comprises one 

20 or more cameras mounted together in a unit. Each camera sees a reference pattern in 
the form of points, lines or other easily recognizable objects. For each position of the 
sensor unit I, the points 9 in the reference pattern 8 are imaged through the lens 19 
onto the sensor 20. The data is transferred to the computing unit 5. Software in the 
computing unit calculates the position and orientation of the position measuring unit 3 

25 relative to the reference pattern 8. The position measuring device in figure 4 is shown 
with carrying handle 21 and activation switch 22 for manual operation. Also shown is 
an illumination source 23 for illumination of the reference pattern 8, and a mechanical 
probe 24 for point by point measurement by touching an object, as described in 
Norwegian patent No. 303.595. 

30 

It will be advantageous if the reference pattern 8 is known in the coordinate system of 
the object, or is a part of the object itself as depicted in figure 2. This can be achieved 
if the object has holes that can be recognized by the position measuring device, or if 
the reference pattern is attached to the object, e.g. by mounting easily recognizable 
35 targets into holes or depressions in the object. These targets may e.g. be purely 
passive markers, light sources, light reflectors or similar. 
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It is significant that the geometrical relationship between the scanner unit 2 and the 
unit 3 for measuring position be known and stable. This can partly be achieved 
through a stable, precise and known mechanical construction, and through separate 
calibration as described below. 

5 

The sole purpose of the robot 4 is to position the sensor unit 1 in the correct position 
and orientation relative to the object 6. Several types of robot principles may be used, 
e.g. arm robots, Cartesian robots, and robots with one, two, three or more degrees of 
freedom. The robot may be controlled by a predefined program, or by using the 
10 measured position of the sensor unit relative to the object and feed the robot 
instructions for relative movement in relation to the current position. 

For each position, the data from sensor unit 1 must be evaluated in the same global 
coordinate system 13. This requires that the relationship between the coordinate 

is system Xs, Ys, Z s , of the scanner unit and the coordinate system of the unit for 

measuring position Xc, Yc, Zc is known. Figure 5 illustrates a method for determining 
this relationship. The sensor unit 1 is positioned such that at least three of the 
reference points 9 are inside its measurement volume. By simultaneously registering 
the position of the reference points relative to the coordinate system of the scanner 

20 unit, and the position of the unit for measuring position relative to the reference 
points, the information required to calculate the transform between these two 
coordinates is acquired. 



Amended Patent Claims 

1. 

System for detection of the surface geometry of an object (6), comprising a sensor 
unit (1) with apparatus (2) for local, point by point detection of surface geometry, and 
a robot unit (4) for moving the sensor unit (1), characterized in that 
the sensor unit (1) includes an optical scanner unit (2) for non-touch probing and 
detection of the surface geometry of the object, and a position measuring unit (3) 
consisting of a camera-based sensor (7) designed for registering an image of a 
network (8) consisting of reference points (9) in known positions and for determining 
the position of the sensor unit (1) in a global coordinate system defined by said 
network (8) of reference points (9), and that a computing unit (5) is provided and 
designed for collection of data from the scanner unit (2) and the position measuring 
unit (3) and for transformation of the data from the scanner unit (2) to relate them to 
the global coordinate system. 

2. 

System as defined in claim 1, characterized in that 

the robot unit (4) is designed for stepwise movement of the sensor unit (1). 
3. 

System as defined in claim 1, characterized in that 

the network (8) of reference points (9) is on the object, and that 

the position for each reference point in the network is known relative to a coordinate 

system related to the object 

4. 

System as defined in claim 1, characterized in that 

the robot unit (4) is designed to move the sensor unit (1) step- wise over the object (6). 
5. 

System as defined in one or more of the preceding claims, characterized in that 
the scanner unit (2) is chosen from the following group: laser scanner, single-point 
distance meter, laser-based triangulation sensor combined with camera, triangulation 
sensor with two-axis scanning laser, triangulation sensor with laser raster projection in 
combination with camera, sensor based on pattern projection combined with at least 
one camera. 
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6. 

System as defined in one or more of the preceding claims, characterized in that 
the robot unit (4) is chosen from the following group: arm-based robot, Cartesian 
robot, robot with one, two or more degrees of freedom, program controlled robot, 
real-time position-controlled robot based on registered position of the sensor unit (1) 
in relation to the object and instruction for movement relative to current position. 

7. 

System as described in one or more of the preceding claims, characterized in that 
said camera in the unit (3) for measuring position is a CCD camera. 

8. 

System as described in claim 3, characterized in that 

the reference points (9) are holes or depressions in the surface of the object (6). 
9. 

System as described in claim 3 or 8, characterized in that 

the reference points (9) consist of so-called "targets" placed on the object (6) or in the 
mentioned holes or depressions in the surface of the object (6). 

10. 

Method for detection of the surface geometry of an object (6), including use of a 
sensor unit (1) comprising apparatus (2) for local, point by point detection of the 
surface geometry, a position measuring unit (3) to determine the position of the sensor 
unit in relation to a network (8) of reference points (9) in known positions relative to a 
global coordinate system, and a robot unit for moving the sensor unit, characterized in 
the steps of: 

positioning the sensor unit (1) such that a region of the surface of the object (6) is 

inside a measurement volume of the apparatus (2), 

optically scanning said region by means of said apparatus (2); 

determining by means of said position measuring unit (3) simultaneously the position 
of the optical scanning apparaus (2) relative to the coordinate system of the network 
(8), and 

transferring data from the scanning apparatus (2) to a computing unit (5) where said 
data are transformed to the coordinate system of the network (8) and stored. 
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11. 

Method as specified in claim 10, characterized in stepwise moving of the sensor unit 
(1) by means of the robot unit (4). 

12. 

Method for calibration of a sensor unit (1) which comprises apparatus (2) for local 
detection of a surface geometry, and a position measuring unit (3) to determine the 
position of the sensor unit in a global coordinate system relative to a network (8) of 
reference points (9) in known positions, and where the sensor unit (1) is mounted on a 
robot unit (4) for movement relative to an object (6), characterized in the steps of: 

a) positioning the sensor unit (1) such that at least one of the reference points (9) is 
inside a measurement volume of the apparatus (2), said apparatus capable of optical 
scanning, 

b) determining the position of the reference point (9) relative to the optical scanning 
apparatus (2), 

c) determining by means of the position measuring unit (3) simultaneously the 
position of the sensor unit (1) relative to the coordinate system of the network (8), 

d) repeating steps a-c or b, c until the position of at least three reference points (9) 
have been determined relative to the coordinate system of the optical scanning 
apparatus, and 

e) calculating a transformation matrix based on data registered by the scanning 
apparatus (2) and the position measuring unit (3) to describe the mutual relationship. 
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(57) Abstract: System for detection of the surface geometry of an object (6), comprising a sensor unit (1) with apparatus (2) for 
local, point by point detection of surface geometry, and a robot unit (4) for moving the sensor unit (I), in the sensor unit (1) there 
is included an optical scanner unit (2) for non-touch probing and detection of the surface geometry of the object, and a position 
measuring unit (3) designed to determine the position of the sensor unit (1) in a global coordinate system defined by a network (8) of 
reference points (9) in known positions. A computing unit (5) is provided and designed for collection of data from the scanner unit (2) 
and the position measuring unit (3) and for transformation of the data from the scanner unit (2) to relate them to the global coordinate 
system. Further, there is present a method for detection of the surface geometry of an object (6), and a method for calibration of a 
sensor unit (1). 
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